Immersive flight for surveillance applications

In this paper , we present a VR-based first-person view paradigm applied to a tele-surveillance application. Using an Unmanned Air Vehicle (UAV), we have developed an intuitive tangible interface between the pilot and his airship (blimp). The idea is to make transparent the manipulation of an embedded camera by controlling it instinctively with the head’s movement so that the user is available for other tasks such as piloting the blimp. In other words, the user becomes part of the interface. Using the same paradigm for sensing real-time acquired sensor data, a vibro-tactile belt worn by the user will indicate the resistance offered by the wind and thus will increase the feeling of telepresence. The results of our experience show that our system is reliable and enhances the situational awareness of the pilot

Design and Implementation of a wearable, context-aware MR framework for the Chloe@University application

In this paper, we present the technical details and the challenges we faced during the development and evaluation phases of our wearable indoor guiding system which consists of a virtual personal assistant guiding the user to his/her desired destination. The main issues that will be discussed can be classified in three categories: context detection, real-time 3D rendering and user interaction

A virtual 3D mobile guide in the INTERMEDIA project

In this paper, we introduce a European research project, interactive media with personal networked devices (INTERMEDIA) in which we seek to progress beyond home and device-centric convergence toward truly user-centric convergence of multimedia. Our vision is to make the user the multimedia center: the user as the point at which multimedia services and the means for interacting with them converge. This paper proposes the main research goals in providing users with a personalized interface and content independent of physical networked devices, and space and time. As a case study, we describe an indoors, mobile mixed reality guide system: Chloe@University. With a see-through head-mounted display (HMD) connected to a small wearable computing device, Chloe@University provides users with an efficient way to guide someone in a building. A 3D virtual character in front of the user guides him/her to the required destinatio

Services surround you:physical-virtual linkage with contextual bookmarks

Our daily life is pervaded by digital information and devices, not least the common mobile phone. However, a seamless connection between our physical world, such as a movie trailer on a screen in the main rail station and its digital counterparts, such as an online ticket service, remains difficult. In this paper, we present contextual bookmarks that enable users to capture information of interest with a mobile camera phone. Depending on the user’s context, the snapshot is mapped to a digital service such as ordering tickets for a movie theater close by or a link to the upcoming movie’s Web page

A virtual 3D mobile guide in the INTERMEDIA project

In this paper, we introduce a European research project, interactive media with personal networked devices (INTERMEDIA) in which we seek to progress beyond home and device-centric convergence toward truly user-centric convergence of multimedia. Our vision is to make the user the multimedia center: the user as the point at which multimedia services and the means for interacting with them converge. This paper proposes the main research goals in providing users with a personalized interface and content independent of physical networked devices, and space and time. As a case study, we describe an indoors, mobile mixed reality guide system: Chloe@University. With a see-through head-mounted display (HMD) connected to a small wearable computing device, Chloe@University provides users with an efficient way to guide someone in a building. A 3D virtual character in front of the user guides him/her to the required destination

Contextual Bookmarks

The role of digital information in everyday life divides out activities in interacting with the physical and the digital world. There is no connection between these worlds that is easily accessible, even though physical objects, persons, and real world events often have digital counterparts. The physical reality is actually overlaid by an additional virtual or digital layer. As we are acting in the physical and the digital world it is desirable that we can use links that bridge the gap between both worlds. In this paper we describe our approach to narrow this gap. Starting from a scenario that shows the demand for such connections, we present an architecture that allows users to bookmark specific situations. Based on these contextual bookmarks the user can request additional digital information. Our first prototype enables the user to bookmark content shown on public displays by taking photos of the display using a mobile phone. Our system combines content analysis of the photo with context information such as position, creation time, etc. in order to form the basis to establish a link to the digital world. The presented architecture will serve as a flexible solution to find and integrate further connections between the physical and the digital world

Chloe@University: An indoor, HMD-based mobile mixed reality guide

This paper describes an indoors, mobile mixed reality guide system: Chloe@University. With a see-through head-mounted display (HMD) connected to a hidden small computing device, Chloe@University provides users with an efficient way of guiding in a building. Augmented 3D virtual character in front of a user guides him/her to destination so that he/she can just follow the virtual guide after the user gives a voice command with desired destination to it. The most suitable virtual character is selected depending on a user’s preference for personalized service. For adapting to different indoor environments, the proposed system integrates various localization approaches. In addition, it supports different access right to a building map based on user profiles and security level

Erratum to: 36th International Symposium on Intensive Care and Emergency Medicine

[This corrects the article DOI: 10.1186/s13054-016-1208-6.]